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Abstract 

A new representation of Game Theory is developed in this paper. State of 
players is represented by a density matrix, and payoff function is a set of hermi- 
tian operators, which when applied onto the density matrix gives the payoff of 
players. By this formalism, a new way to find the equilibria of games is given 
by generalizing the thermodynamical evolutionary process leading to equilibrium 
in Statistical Mechanics. And in this formalism, when quantum objects instead 
of classical objects are used as the objects in the game, it naturally leads to the 
Traditional Quantum Game, but with a slight difference in the definition of strat- 
egy state of players: the probability distribution is replaced with a density matrix. 
Further more, both games of correlated and independent players can be repre- 
sented in this single framework, while traditionally, they are treated separately by 
Non-cooperative Game Theory and Coalitional Game Theory. Because the density 
matrix is used as state of players, besides classical correlated strategy, quantum 
entangled states can also be used as strategies, which is an entanglement of strate- 
gies between players, and it is different with the entanglement of objects' states as 
in the Traditional Quantum Game. At last, in the form of density matrix, a class 
of quantum games, where the payoff matrixes are commutative, can be reduced 
into classical games. In this sense, it will put the classical game as a special case 
of our quantum game. 

Key Words: Game Theory, Quantum Game Theory, Quantum Mechanics, Hilbert 
Space, Probability Theory, Statistical Mechanics 
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1 Introduction 



For static non-cooperative games, theoretically Nash Theorem gives a closed conclusion 
on the existence of equilibrium. However, the way to calculate the equilibrium of general 
games are still open, and so far the existing methods seem not very general. 

On the other hand, in Physics, we do have similar situations and solutions, and 
they provide prototypes to deal with the problem above. In Statistical Mechanics, 
principally or at least practically, we have no dynamical evolutionary process, or say, 
by first principle, leading to thermal equilibrium, but the definition of thermal equilib- 
rium is definitely clear, and we do have some pseudo-dynamical processes such as the 
Liouville-von Neumann equation for relevant partial system^ or artificial man-made 
evolutionary processes, such as Metropolis Method[2], giving the correct thermal equi- 
librium in a quite general sense. Now we want to apply this experience onto Game 
Theory. 

The basis of such application is the same mathematical form should be used in 
both Physics and Game Theory. Here, we choose density matrix as this basis. The 
equilibrium of a statistical system is defined as 

P(x-f3) = ^e-^\ (1) 

where x is the dynamical variable, usually including general position and general mo- 
mentum, and Z is the normalized constant, 



dxe-^. (2) 



Or for a quantum statistical system, 



P(E n ;P) = ±e-P E », (3) 

where 

Z = J2^ En , (4) 

n 

and n is the complete good quantum number for this system. The above definitions 
can be unified as an operator form, that 

p(f3) = ^e-^, (5) 

and 

The way to use an operator form for classical systems may seem wired even for readers 
in Physics. However, it's quite trivial if we regard classical systems as systems always 
having trivial eigenstates with eigenvalues x, that 

H\x) = E (x) \x) , (7) 
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and with normalization 

(£' \x) = 5(x-x l ) . (8) 

Such unification of notation brings nothing new into Physics, but in this paper, the 
operator-form formalism unifies all the formulas so that easy to apply onto both classical 
and quantum game. It's helpful to make an immediate application of this notation, 
that the operator form of classical thermal equilibrium can be written as 

^classical (£) = 1 J dxdx' \x') (x'\ \x) (x\ 

= ^Jdxdx , \x f )e-^ E ^5(x^-x)(x\ (9) 
± fdx\x)e-P E W (x\. 

It's important to notice the general character that for a classical system that only the 
diagonal terms exist, while for a quantum system, it depends on the basis. Especially, 
for basis {|x}}, the eigenvectors of position vector X, usually, the density matrix has 
the off-diagonal terms. 

Then all thermal dynamical quantities should be averaged over the whole space from 
dynamical variables according to this Boltzman distribution. However, for a many-body 
system, such summation over the whole space is not an easy mission. So average over 
a sampling of this distribution is used to replace the whole space summation. The 
idea is if we have the dynamical process driving the system into thermal equilibrium, 
then we can just start from an arbitrary initial state, and then let the system evolute 
according to the dynamical process. After some long time, we record the trajectory, and 
use the states on this trajectory as samples of equilibrium states. Then, the average 
can be done on those samples. Unfortunately, principally we don't even have such 
dynamical process. However, the artificial man-made evolutionary process, such as 
Metropolis Method, survives this idea. The idea of Metropolis Methodj2j is to define 
an evolutionary process also leading to the right thermal equilibrium not from first 
principle such as dynamical equations, but from the detailed balance principle, which 
is 

w (x -» f ) e -P E W 



-fiEix) 



(10) 



This will give us the transition rate between states x and x' with the help of other 
arguments 2 . Then, the system can start from an arbitrary initial state, and at every 
time step, according to the probability given by the transition rate, it moves onto or 
rejects a new test state randomly chosen from all other states. For a short summery, 
whatever the detail of the evolutionary process will be, the conclusion is, for a system 
described by Hamiltonian, we do have some methods to get the thermal equilibrium. 

Now we apply this idea onto games. The first requirement is the system should be 
described by a Hamiltonian such as a hermitian operator H. And the state of system 
should be represented by a vector x or \x). How far away does the current formalism 
of Game Theory leave from those two requirements? Traditionally, the description 
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of system-level state does not exist but only a set of states for every single player, 
which are a set of probability distributions over their own strategy spaces. Or, say, 
in non-cooperative static game, state of player is {p 1 }, where every p l is a probability 
distribution, such as 

vHs\)=pI (ii) 



or in our notation, 

i 

It's natural to form a system- level distribution for iV-player game as 

i , (ii-,«=«-* ( 13 ) 

or in our notation, 

N 

p s = Up t = E pU ■ ■ • p& I 4 .4 € I • (w) 

i=i {k} 

Therefore, the state seems not very far away from the requirement, at least we already 
have the vector form as (s^, . . . , sf^J , or s^, . . . , sfj\. The main problem is at the 
payoff function. 

Traditionally, in a iV-player game, every player is assigned a payoff function M l , 
which linearly maps N vectors into a real number, or technically speaking M l is a 
(0, iV)-tensor. However, an hermitian operator H is required to be a (1, l)-tensor, 
which maps a left vector and a right vector into a real number. Constructing H l from 
M l will be a significant step in our formalism. This will be done in section After 
we get H l , we will see it's truly hermitian. 

The main task of this paper is to develop a Hamiltonian Formalism for Game 
Theory. For classical game, it's mainly from M' 1 to H l . And then we will show the 
value of such new representation. Another thread leading to this paper, is to consider 
the game-theory problem that when we replace the classical object with a quantum 
object, what we need to do for the general framework? Here the object refers to the 
object which the strategies of the game apply on, such as the coin in the Penny Flipping 
Game (PFG). 

Game Theory^ is to predict the strategy of all players in a game, no matter a 
classical object or a quantum object is used as the game object which strategies acts 
on. For example, when we talk about 2-player PFG, the object is a coin, which is a 
classical object with two basic states {l(head), — l(tail)}, so the strategies we can use 
are Non-flip and Flip. We denote them as I, X respectively, for some reason will be 
known soon. So the strategy state of every player is a probability distribution over 
{I,X}. Now, consider a quantum object, a ^-spin instead of a penny. A spin has 
more states than a penny. The difference is a penny only has probability combination 
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over {1,-1} states, while a spin has coherent combination over {1,-1} states. Or 
technically, we say, a general state of a spin is 



\spin) = a\+l)+0\-l), (15) 
with constrain, a* a + (3* (3 = 1 while a penny state is a probability distribution such as 

p(+l)=p + ,p(-l)=p-, (16) 
1. It's easier to distinguish those two objects by using density 



with constrain, p + +p 
matrix, 



P 



spin 



a* a |+1) (+1| + f3*a |+1) (-1| + a* |-1) (+1| + (3* (3 |-1) (-1| , 



(17) 



while 



ppenny = p + | + ^ + p - _ ^ 

The way that we use density matrix to describe state of classical object recalls the same 
treatment and understanding mentioned above as in equ®. We see that for classical 
object, at least the density matrix provides equivalent information with probability 
distribution. Because of these extra states, the strategy (operator) space over quantum 
object is also larger than the one over the corresponding classical object. Here, explic- 
itly, for spin, we have four basic strategies (operators): I,X,Y,Z v.s. I,X for penny. 
Here /, X, Y, Z refers to identity matrix, and three Pauli matrixes, 



I 



1 
1 



X 



1 

1 



Y 



-i 

1 



Z 



1 
-1 



(19) 



It's easy to see that X exchanges the states (+1, —1) and / keeps the states. A general 
quantum operator can be expressed as 



7 P + 

cos — cos 

2 2 



—l+i sin — sin 

2 2 



> v ■ • 7 P~S V . 7 ■ 0+5 y 

-X — ism — cos Y —i cos — sin Z 

2 2 2 2 



(20) 

where a, (3, 7, 8 are real number [1]. Therefore, the classical probability distribution over 
/, X for classical game should be replaced by a quantum probability distribution over 
/, X, Y, Z for quantum game. 

However, there are two ways to do this generalization. One is to consider a classical 
probability distribution over all quantum operators. This was widely used in EE E IHj , 
where the distribution will be a classical probability combination as, 



player 

Pci 



p player (a,0, 1 ,8)\s)(s\. 



(21) 



We will discuss this in more details in section < j4.1L Another way is a density matrix 
on the basis of {/, X, Y, Z}, so that 



X,ae{I,X,Y,Z} 



(22) 
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In section tj4.ll we will compare those two and conclude they are different, and hopefully 
give a conclusion that the second definition pn^f er should be used. 

Because the system-level state is our fundamental dynamical variable, this repre- 
sentation is born as a way to deal with both non-cooperative and coalitional games. So 
section H4,2l is devoted to discuss about correlated strategy state between players. Here 
correlation refers to both classically correlation and entanglement in quantum sense. 
We mainly want to distinguish the difference between the entanglement coming from 
the object states when there are more than one sub-objects in our quantum game, and 
the entanglement coming from correlated players. In that section, we will also show a 
thread on the way to generalize our formalism to explicitly include Coalitional Game 
Theory. 

In the last part of this paper, we come back to our starting point, whether this 
new formalism helps to find the Nash Equilibria. We have not got a general conclusion 
yet, so just one representative example is discussed. Also we will put classical game as 
a limit situation of our quantum game when the payoff matrixes {-ff 1 } have a special 
property, namely "Reducible" and "Separable". 

2 A short historical introduction of Traditional Quantum 
Game Theory 

Usually, a static and non-cooperative game can be defined as triple (N, S, G), in which 
N is the set of N players, § is the strategy space S 1 x S 2 x • • • S N and S l is the L«- 
dimension strategy space of player i, and G is a linear mapping from § to N-dimension 
real space R^. S l is expanded by basic pure strategies {sfy, where I = 1, 2, . . . , Lj. We 
denote the set of these pure strategies as B (S 1 *) , which also means the basis of strategy 
space S l . The difference and relation between S l and B fS'M is extremely important 
in our future discussion, especially in section N4.ll Originally, G is only defined on the 
pure strategies, from B (5 11 ) x • • • x B (S N ) to M. N . The idea of mixed strategy game 
generalizes the G onto the whole space of §, by probability average of the pure strategy 
payoff 3 . 

Traditionally, in Classical Game Theory, it has never been explicitly pointed out 
the relation between strategies and operators acting on game object, even the existence 
of such game object is usually neglected, so the strategies are considered abstractly 
and also the space § is an abstract vector space. Because only the real numbers in 
probability distribution are needed for discussion, such a vector space is considered as 
a N x L dimensional Normalized Euclidian Space (NM ArxZ/ ) with constrain ^2iP\ = 1, 
where p\ is the probability of strategy s\. We know that Quantum Mechanics is about 
the evolution over Normalized Hilbert Space (NHT^^) with constrain Tr (p) = 1. 
It's easy to show, even just from our discussion on the relation between classical and 
quantum density matrix in the introduction section, NH ArxZ/ covers all the structures 
of NR iVxL , just like the relation between C and R. 
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Because this abstractness of strategies and the similarity between NM Arxi and 
NH ArxL , in 0, it has been pointed out that strategy state can be expressed as vec- 
tors in Hilbert space of strategies. The authors constructed the math form from the 
experience of Classical Game. Bra and ket Vector and even Density Matrix has been 
used to represent a strategy state there. In jHUHj, it's emphasized that the strategies 
should be operators on Hilbert space of object, not the vector in Hilbert space of object. 
Therefore, the starting point of 9] seems wrong although the theory looks beautiful. 
According this, the whole set of quantum operator should be used as strategies, and 
the strategy state of a player is still a distribution function over this strategy space. In 

it has been noticed that a set of operators can be chosen as a basis of the operator 
space. So that the operator space is also a Hilbert space. But there the strategy state 
of a player is still a distribution over the whole operator space, and now, with base 
vectors. We name this quantum game using a probability distribution as the strategy 
state as Traditional Quantum Game (TQG). Works in this paper, can be regarded as 
a continue along this direction. Our idea is, since the operator space is also a Hilbert 
Space, the idea of using vector and density matrix to represent strategy is correct again, 
although at a new level. So in our new formalism, the strategy state will be a density 
matrix not a probability distribution. 

Because both the classical game and TQG use the probability distribution although 
over a larger space, some criticism has been raised such as in JOj- I n that paper, 
the authors asked the problem what's the real difference between so-called quantum 
game raised from above papers H3 E] and the classical game. Their answer is that 
no principal difference exists. Because the new game can be regarded just as a clas- 
sical game over a larger space with more strategies. Recalling our penny and coin 
example, the only thing changes in the abstract form of the new game is that a prob- 
ability distribution over {/, X} is replaced with another probability distribution over 
{S = al + f3X + fjY + vZ}, which has infinite elements. Therefore, the new game is a 
infinite-element version of the classical game, there is no principal difference. We agree 
with this conclusion, and that's just why we think our new representation should be 
used not the TQG. A density matrix over {I,X,Y,Z} is definitely different with both 
classical probability distribution over {I,X} and the probability distribution over {S}. 

In [Jj, the authors provided another argument about the value of the TQG. It's 
about the efficiency. They have claimed that the efficiency of TQG will be significantly 
higher than the corresponding classical one. In this paper, we don't want to comment on 
this issue. Because principally, our new representation is already a new game compared 
with the classical game. Discussion about efficiency will be a minor topic later on if 
necessary. 

In |12l I13| . we have developed the ideas about the general framework, but mainly 
from the background of Classical Game Theory, without a full acknowledgement of the 
development of TQG. In those papers, by using the basis of operator (strategy) space, 
a full math structure of Hilbert space is applied onto Game Theory, including Density 
Matrix for the Strategy State of one player and all players, Hermitian Operator on the 
operator(strategy) space as Payoff Matrix, and also several specific games are analyzed 
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in the new framework. But we haven't show the difference between our new quantum 
game and the TQG proposed in jSJ H3 E] , and neither emphasized on the privilege 
of this new representation. In this paper, we will present our general formalism in a 
slight different way with more links with TQG and try to answer those two questions. 
Also we will compare our game with the classical game, in the language of our new 
representation. 

In the next section (U3J), following the logic above, first, we want to explicitly point 
out the relation between strategies and operators over state space of object. Therefore, 
a new concept as Manipulative Definition of game is introduced. 



3 Manipulative definition and abstract definition 

The manipulative definition of static game is a quadruple 

T m = (p° eH°,S^ {s i G , C, P = {P*}) , (23) 

and the payoff of player i is determined by 

E i (p)=Tr(p i jr(S)p° CHS)). (24) 

Let's explain them one by one. TL° is the state space of object, and p$ is its initial state. 
We denote this space as 7i° because we has shown previously that even for a classical 
object, its state in probability space can be equivalently expressed in Hilbert Space 
although no more information is provided. So notation 7i° can cover both classical 
and quantum objects. Every S l is Ti* , the operator space over Ti°. S is a combination 
of s l € S l , and here s l is a single pure strategy. A generalization from this definition 
of pure-strategy game into mixture-strategy game, even into coalitional game will be 
done later on by deriving abstract definition from manipulative definition. C is a 
linear mapping from S to Ti* so that it will give an effective operator over Ti° from 
the combination of S. After we get such an effective operator C(S), the object will 
transfer to a new state according to the effect of such operator so that the new state is 

p° new = C(S)p° CHS). (25) 

Then P l , the linear mapping from Tt° to M gives a scale to determine the payoff of 
every player. All games can be put into this framework. The linear property of C and 
P % is an essential condition of Game Theory. 

The abstract definition mask the existence and information about the object. It's 
defined dipole 

r a = \^ P S e§±Jl®S\H ±{11*}] , (26) 

and H l is mapping from § to R so that the payoff is determined by, 

E* = Tr (piT) . (27) 
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Compare eau ()24|) with eaul|27|l. we will see that H l should include all information 
implied by C and P i . Besides this, here p s , a density matrix state of all players, is 
also slightly different with S, the strategy combination in the manipulative definition. 
While S can only be used in pure-strategy game, p s can be used for general mixture- 
strategy game and coalitional game. Before we construct the relation between S and 
p s , and between (/?q, C, P 1 ) and H l , we want to compare our definition with traditional 
one first, and give some examples in above notation. 



3.1 Example of classical game: Penny Flipping Game 



In a 2-player PFG, each player can choose one from two strategies {I,X}, which rep- 
resents Non-flip and Flip operator respectively, and initially, the penny can be in head 
state, after the players apply their strategies in a given order such as player 1 before 
player 2 (here, this order is not a physical time order but a logic order still happens at 
the same time. Sometimes, this order will effect the end state of the object) the penny 
transforms onto a new state, and then, the payoff of each player is determined by the 
end state of the penny. For example, player 1 will win if it's head, otherwise player 2 
wins. In above notations, the manipulative definition of this game is, 



p8 = I+i) 



1 




s 2 



{I,X}, C = s 2 s\ P 1 



1 

-1 



(28) 

Substituting all above specifics into the general form eau (|2"3*)) . it's easy to check it gives 
the correct payoff value of each player as described by words above, even when s 1 ,^ 2 
are distributions not single strategies. 

The abstract definition is given by 



H 



1,2 



1,-1 














-1,1 














-1,1 














1,-1 



(29) 



For a comparison, we also give the usual traditional definition V = (S, G, N) , where G 
is the payoff matrix, 



G 



(30) 



1.2 _ 1,-1 "1,1 
-1,1 1,-1 

Later on, we will construct explicitly the relation between P, H and G. But at current 
stage, we need to notice that po,£,P in manipulative definition contains equivalent 
information with G in traditional abstract definition and H in our new abstract defi- 
nition. Furthermore, we will see the generalization from G to H will give our theory 
the power to put both quantum and classical game into the same framework, and the 
introduction of the manipulative definition will provide a very natural way to raise 
quantum game. 
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3.2 Example of quantum game: Spin Rotating Game 



Now, we replace the penny with a quantum spin, which has the general density matrix 
states, p° G H°, and its operators (strategies) form a space H*, whose basis is B (H*) = 
{I,X,Y,Z}. Its' manipulative definition is 



Po = l+l) 








s 1 = s 2 = n* c 



P 1 



1 









-P 2 



(31) 

where TL* = E {I, X, Y, Z} refers to the Operator Space expanded by base vectors 
{I,X,Y, Z}. Sometimes, we also denote this relation as M(Ti*) = {I,X,Y, Z}. We 
call this game as Spin Rotating Game (SRG). Compared with PFG, the only difference 
is the set {I, X} is replaced by IL{I,X,Y,Z}. This replacement is nontrivial. It's 
different with a replacement between {I,X} and {I,X,Y,Z}. The later means the 
number of pure strategies grows from 2 to 4, but in the former it grows from 2 to oo 
because the operator space has infinite elements. 

The abstract definition is given by 



H 



1 








1 





1 


— z 








i 


1 





1 








1 





-1 


—i 





-1 








1 


—i 








i 





-1 


— i 








i 


-1 





i 








— z 


-1 








1 





i 


-1 





1 








1 





1 


—i 








i 


1 





1 








1 





-1 


—i 





-1 








1 


— i 








i 





-1 


— i 





1 








1 





1 


— i 










1 





1 








1 


i 








i 







1 








-1 







i 








i 





1 


i 





1 








-1 


i 








—i 





1 


/. 








i 


-1 





i 








— z 


-1 








1 





i 


-1 





— i 








— i 





— i 


-1 








1 


— i 





— % 








—i 


1 








1 





1 


—i 










1 





1 








1 





—i 


1 





—i 








i 


1 








-1 





— i 


1 





1 








1 





1 


—i 








i 


1 





1 








1 





-1 


—i 





-1 








1 


— i 








i 





-1 


— i 








i 


-1 















-1 








1 







-1 





1 








1 





1 


— i 








i 


1 





1 








1 

(32) 



In the traditional language of Classical Game Theory and also in the language of TQG 
(yes, they are the same thing when both refer to the games on quantum objects), 
the payoff function for each player is an infinite-dimension matrix, the corresponding 
element when player 1, 2 choose strategy s ,2 = a 1,2 1+ ft 1 ' 2 X + p 1,2 Y +v 1,2 Z respectively 
is, 



K_J -I o 



Tr{P 



2\t 



(33) 



where P ,2 and are given in the manipulative definition, equ (|31j) . Therefore, at last, 
the payoff functions will be functions of the parameters a. ' 2 ,/3 ' 2 ,p, ' , u > 2 . Later on, 
we will know, definitions of classical game equ (|2*H|) . equ (|2*H|) and equ(|30j) are equivalent, 
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while the definition of quantum game should be in the form of eau (|3*Tj) or eaul[32j). but 
not eau (|3*3*)) . 



3.3 Prom manipulative definition to abstract definition 

We have given the definitions and the examples, and compared them with the usual 
form in the notation of classical games. In a sense, the manipulative definition is more 
fundamental because all its rules are given directly at the object and operator level. 
Now we ask the question how to construct the abstract form from the manipulative 
form, or in another way, where we got the two abstract form H ' 2 for the two games 
above? And why we think the two forms give the equivalent description of the same 
games? 

We know the state of object, no matter when it's classical or quantum object, can 
be written as density matrix. The idea to derive abstract form from manipulative form 
is to represent state of players by density matrix in the strategy space. In order to do 
this, the strategy space has to be a Hilbert Space. We already know that, in Physics, 
the object state space H° is a Hilbert Space and single-player strategy space is S l = 7i*, 
the operator space over Ti°. This operator space with natural inner product as 

(A\B)±(A,B) = ^^±, (34) 

will become a Hilbert Space. Therefore, the language of density matrix can be applied 
in the strategy space now. The total space of states of all players should be a product 
space of all such single-player strategy spaces, 

TV 



S = JJ®5*. (35) 



So a state of all players is a density matrix p in S. Denote the basis of § as B (§), then 

P S = E /Vl^>H- (36) 

In a special case of noncooperative game, the density matrix over the total space S can 
be separated as 

P^Up^flTr-iip 8 ), (37) 

8=1 8=1 

where Tr_j (•) means to do the trace over all the other spaces except S l so that p l is a 
density matrix over S l , 

p l = E MfiW- (38) 

We have discussed in the section of introduction, state of players of classical game only 
need the diagonal terms of this density matrix because only a probability distribution 
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over strategy space is needed in classical game, and diagonal terms of density matrix 
provide the equivalent structure of probability distribution. So, why here we need a 
general density matrix, not a probability distribution again? 

For simplicity, let's discuss this issue in S l , a single-player strategy space, and by the 
example of SRG, and then the general counterpart in S will be very similar. The basis 
of S l is B (S l ) = {I, X,Y, Z}. When the player takes strategy s l 6 S l , for example, 
s l = -j= [X + Y), according to our general form, it must be able to express into the 
form of density matrix, such as 

P l = \s*) {s % \ = \ (\X) (X\ + \Y) (Y\ + \X) (Y\ + \Y) (X\) . (39) 

This naturally requires the off-diagonal terms such as \X) (Y\. We know that the prob- 
ability distribution is used for classical system but density matrix is used for quantum 
system. In fact, here we have the same relation. Probability distribution is good for 
state of players in games on classical objects, but density matrix should be used for 
state of players in games on quantum objects. In this view point, such generalization is 
quite natural. In the next section f H4. 1ft . we will discuss another way of generalization 
and compare it with our language of density matrix. 

Now, the problem about state has been solved. Next problem should be how to de- 
fine Hermitian Operator H l over § to give payoff as required in equ (|27|) . The definition 
is, for any given basis [a, v G B (S), 

{ l i\H i \ V ) = Tr(p i £{v)pltf(n)). (40) 

Or for a classical game, because the strategy density matrix has only diagonal term, 
when we do the trace required in equ (|27|) . only the diagonal terms of the payoff matrix 
will be effective. So for classical game, it can be defined as 

{p\H i \p)=Tr{p l C{p)p°^{p)). (41) 

Apply this general definition onto SPG, we get 

H l ^ W = <^V 2 1 H* |*V) = Tr (pWpI , (42) 

then H 1,2 will be a 16 x 16 matrix. And similarly, onto PFG, we get 4x4 matrixes, 
defined as 

It's easy to check ((/i| H l |^))* = {v\ H l \p) so that 

= H\ (44) 

Meaning of the diagonal terms such as {p \ H l \p) is just the payoff of player i when the 
state of all players is \p), however, the meaning of the off-diagonal terms is not such 
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straightforward. For games on quantum objects, generally the off-diagonal terms are 
necessary. For example, in SRG, when the basis {I, X, Y, Z} is used, s = is also 
a pure strategy, so we will need to consider the payoff when both players choose this 
pure strategy. This is 

{ss\H i \ss) = \{{X + Y){X + Y)\H i \(X + Y)(X + Y)) 

, (45) 

= \ ((XX\ H % \XX) + (XX\ H l \XY) + ■■■ (YY\ H % \YYj) 

totally 16 terms including the off-diagonal terms such as (XX \ H l \XY). For games on 
classical objects, it's always possible to find a basis, under which all IPs have only the 
diagonal terms. But for games on quantum objects, generally, it's not. In section 
we will discuss this in more details, try to find the condition when quantum games can 
be reduced into classical games. 

Now, our general definition of both quantum and classical games has been given, 
starting from the manipulative definition. In fact, in some sense, this is a generalization 
from manipulative to abstract definition, not just a transformation. In the former, only 
non-cooperative players are allowed, because the whole state p s is a product of single- 
player state p l , but in the later, a general non-direct-product density matrix p s ^ 
n*=i P % can be used as state of players. This will include the coalitional games (where 
the players are correlated by the way of classical correlated probability distribution) into 
the same framework, even also including quantum correlated players. This is different 
with the correlation coming from the classical or quantum objects. The details will be 
discussed in 

In order to give a complete definition of Game Theory, we need to redefine the Nash 
Equilibrium (NE) for both classical and quantum games, and generalize it a little onto 
games with state of players as a non-direct-product density matrix. NE is redefined as 
pfg that 

E? (p S eq ) > (2V (p s eq ) j) , Vi, Vp\ (46) 

The special case of this definition, when we consider non-cooperative classical game, 
naturally becomes the usual NE, pf = (p\ q ■ ■ ■ p\ q ■ ■ ■ p*Q , that 

E l ( P \ q ■ ■ ■ Pl q ■ ■ ■ 4) > & {p\ q ... ^ ... 4) , Vi, Vp\ (47) 

This should be easily recognizable for readers from Game Theory. Now our goal of Game 
Theory becomes to find the NE pf q as in equ (|46|) in the strategy space 

ofs = nf=i ®s* 

given payoff matrixes H = {H 1 } as in eau H26|) . 

It seems at first sight, even for classical game, this representation is much more 
complex than the traditional one. But, we think this step is necessary for the develop- 
ment of Game Theory, first, because this new representation is a system of Hamiltonian 
Formalism so that it's easy to develop the Statistical Physics upon this; second, games 
on quantum objects require such formalism. 
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4 Compared with TQG 



From section £0 we know there is another kind of Quantum Game Theory, TQG. Is it 
an equivalent theory just another representation, or different with ours? We want to 
compare those two in two aspects: first, the definition of state of all players; second, 
the effect of the correlation coming from quantum objects. 

4.1 Strategy state: density matrix vs. probability distribution 

Let's start from the strategy state of a single quantum player. There are two differ- 
ent possible forms. Recalling the manipulative definition of the two examples, PFG 
in eau (|28|) and SRG in eau (|31jl . the only difference is a finite-element classical pure 
strategy set {I, X} is replaced with an infinite-element quantum pure strategy set 
E {/, X, Y, Z}. Therefore, a natural generalization is to set the state of quantum player 
as a distribution over the quantum operator space S l = E {/, X, Y, Z} as 

P l ' q = Ei^Ml^v 9 *!- (48) 

s i es i 

So a strategy state of all players can be written as 

p s, q = J2 p s, H s)\S)(S\, (49) 

where S = Is 1 , s 2 , ■ ■ ■ , s The meaning of this kind of state is a probability distribu- 
tion over a larger space is used to replace the counterpart in the classical game. But 
principally, there is nothing new in the sense of Game Theory. Such trivial general- 
ization also neglects an important information, that s l is element in space expanded 
by {I,X,Y,Z}, so that there is a relation between s l and the basis {I,X,Y, Z} as in 
equ ([20|) . If we make use of the decomposition in equ (|20|) . then we can denote the same 
relation by a density matrix form, with 16 terms, 

|/> = cos 2 I cos 2 ^ I J) </| + • - • + cos 2 I sin 2 ^ \Z) (Z\ . (50) 
And generally, any single-player states of strategy can be expressed similarly by 

p'= E (si) 

Therefore, a general strategy state of all players should have the form as in equ (|36[) . a 
density matrix over the whole strategy space § expanded by its basis B (S) . 

Now, the problem is whether the definition of eau (|51|) is equivalent with eau (|48|) . 
or not? The answer is definitely not. The normalization conditions from the former 
and the later are 

f E^eB(S*) <H P i \P-) = 1 

(52) 

I J2s^(s i \p i ' q \ si ) = 1 



15 



respectively. The difference can be seen from the following example. 

p* = ~ ( \X + Y) (X + Y | + \X - Y) (X - Y |) (53) 

is a good single-player state when the first normalization is applied, but it's not a 
good state under the second normalization condition. This is easy to see if we apply 
the summation among X,Y, x ^ , t ne result is | > 1. Readers from TQG may 

argue that even in the sense of strategy state of the probability distribution, the density 
matrix above should be recognized only as a probability distribution over x ^ , x ^ so 
that the total probability is still 1. In fact, this implies a very strong assumption that 
( s i I s h) = (y s \ 7^ s 2)i whatever the real forms of them are. First, this assumption is 
totally incompatible with eau ()34|) . our definition of inner product over operator space. 
Second, even under such assumption, looking at the same example, we will find that 
this is good in the sense of probability distribution but not good in the sense of density 
matrix (normalized to when B (S) = {I, X, Y, Z} is used). So the endogenous relation 
among all strategies (operators) and the assumption of orthogonal relation among them 
are incompatible. 

Now, since they are different, which definition should be used? We prefer the 
density matrix over B (§), not the probability distribution over S. The first reason is 
given above that the former one keep the endogenous relation between operators. The 
second reason is even from the practical point view, discussion in density matrix form 
is much easier in probability distribution form as we will see in section H5. 31 when both 
of them are applied onto SRG. 

4.2 Entangled strategy state: correlation between players 

Besides the definition of the new quantum game, another privilege of the new repre- 
sentation is it can be used for coalitional game. An investigation of the detail corre- 
spondence between the new representation and the coalitional game is still in progress, 
but compared with the classical payoff (0, iV)-tensor, which can only be used for non- 
cooperative game, the new representation can be still be used when the players are 
not independent. In the traditional language, the state of all players is determined by 
a combination of all single-player state, which is a distribution over its own strategy 
space. But in our representation, a density matrix over the whole strategy space § is 
used. So principally it can be non-direct-product state, so that 

N 

p s ^l[Tr^(p s ), (54) 
i=i 

In Quantum Mechanics, such state is named as an Entangled State. In our case, be- 
cause, this entanglement is not in the state space of the object, but the strategy space 
of game players, we call this Entangled Strategy State. This entanglement has two 



16 



styles. First, for a classical game, in fact, it means a classical correlation between play- 
ers. Second, it can also be the entanglement between quantum players as in quantum 
game. 

However, no matter which game it refers to, the entanglement is NOT the usual 
entangle states of the object, while currently the most commonly accepted meaning 
of Entangled Game in TQG does come from the entanglement of the initial states of 
the quantum objectsjHl HUj . In TQG, it refers to the situation when more than one 
sub-objects are used as the object of the quantum game. For example, two spins are 
used as the object. Then, the initial state, in our manipulative definition can be 
an entangled state. This effect coming from the entanglement at object level is so- 
called Entangled Quantum Game. We have to point out that this entanglement will 
not lead to an entanglement between players. Only the correlation between players will 
significantly effects the structure of the game, not the entanglement at object level. 
When the p$ is changed, H l will changes together, but nothing need to do about p s . 
By our representation, we have proposed an artificial quantum game, where the global 
optimism solution is an entangled state between plavers[Tl]. In that paper, we proposed 
that when p s is not a direct product state, but 

P s =Hp a % (55) 

where {ctj} is not a set of single players but a set of subsets totally covering the whole 
set of players. Then, any subset on can be regarded as a coalition of players. Therefore, 
a structure of core [3] in Coalitional Game can be very naturally raised from our general 
framework of Game Theory. Generally, if we can get the general NEs defined in equ (|46[) . 
decompose it as far as possible, the subset Oj will naturally forms a structure of core. 
The investigation on the equivalence between this framework and Coalitional Game is 
still in progress. 

4.3 Redundant operators from density matrix form 

There is one serious problem of this density matrix representation of operator: although 
every unitary operator can be expressed as a density matrix form, not every density 
matrix corresponds to a unitary operators or a probability combination of unitary 
operators. In Quantum Mechanics, this is not a problem. Every pure state can be 
described by a density matrix, and every density matrix is a pure state or a probability 
combination of pure states. The difference between here Quantum Game and Quantum 
Mechanics is: the general pure strategy is the expansion of equ (|2()|) . where only three 
real variables are used, while a general pure state is a superposition of base vectors by 
complex variables. For example, (X + iY) will not give us a unitary operator thus not 
a good strategy, but (|T) 2 + i \i) z ) is a good pure state. 

Usually, in quantum world, only unitary operators can be used to manipulate quan- 
tum objects. Because of this, it's possible that when we find pfL, but it in fact is a 
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nonapplicable NE. Two ways may take us out of this problem. One, non-unitary op- 
erator can also be used to manipulate quantum objects. For example, if quantum 
measurement is one of the strategies we can choose, then non-unitary operators are 
also acceptable as strategies. Second, restrict our density matrix to allow only unitary 
operators. Specifically, for SU (2), we have such way of restricted density matrix. From 
equ(J2UJ), if a new basis as {I,iX,iY,iZ} is used, the coefficients in the decomposition 
will be real numbers. Under this new basis, if we restrict elements as real numbers, 
P]j,u ^ ^> then every density matrix corresponds to a combination of unitary operators. 
A general such restricted density matrix has 3 + 6 = 9 independent real elements. A 
probability combination of four orthogonal unitary operators has 3 real number for 
distribution probability, 3 real number for the first arbitrary unitary operators, 2 real 
number for the second one, and 1 real number for the third one, and for the last 
one, so totally also 3 + 3 + 2 + 1 = 9 real variables. Generally, for SU (N), similar 
condition of restriction can be got: finding the decomposition relation similar with 
equ (|20|) . choosing special basis so that all the coefficients are real, and then restricting 
the density matrix only has real elements. 



5 Application of this hamiltonian formalism onto specific 
games 

We have shown that for a classical game, the language of density matrix and hermitian 
operators gives at least the equivalent description and the TQG should be replaced by 
our new quantum game. Now, we consider the following problems. First, if there is any 
privilege that a density matrix language will help to solve the problems in Classical 
Game? Second, whether there are some examples of games, showing that the new 
quantum game should be used instead of the TQG. In the following two sub sections, 
we will answer them one by one. 

5.1 Evolutionary process leading to NEs 

The first problem is actually our starting point of this paper, although in fact, we get 
some results in general representation far away from this point. The motivation driving 
us alone the way of density matrix and hermitian operators is the hope that this new 
formalism will help to construct an evolutionary process leading to NEs from arbitrary 
initial strategy state. 

During our revision of this paper, we noticed that the idea of applying Boltzman 
Distribution and Metropolis Method onto Game Theory has been proposed in |llj . 
There the author suggests a very similar procedure and gives the parameter (5 an 
explanation as a measurement of the rationality of players. Even the equ(3) in that 
paper is exactly the same meaning with our equ(|5fij). However, the algorithm problem, 
although the starting point, is not our central problem. We start our work from it 
but end up at a general representation. So it's a hen for our work, and hopefully it 
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lays a golden egg here, doesn't it? The only difference is that uses the language 
of classical game, so probability distribution and payoff function are used there, while 
here, we use the language of density matrix and hermitian operator. The hamiltonian 
formalism and operator form is easier to be generalized onto quantum system, where 
the quantum state has to be a density operator. Because of this, here we still introduce 
the operator form of this evolutionary procedure. 

The idea is to make use of the Boltzman Distribution as equ(JSJ) to represent the 
density matrix state over the strategy space. Because in our language the payoff ma- 
trixes now are hermitian operators, so e@ Hl does look like a density matrix. The only 
problem is that usually H l ^ H 3 , so there is not a system level payoff matrix, while 
for a physical system, such a system level hamiltonian always exists. Therefore, even 
we generalize the NE onto a general game not necessary non-cooperative, but we don't 
have the way to get such general solution, unless for a special game, where H l = H J . 
But such game is trivial. It's not game any more, but an optimization problem. So at 
current stage, our new representation help us nothing about a general game. Of course, 
we believe this is not because of the representation, but because we haven't found the 
right algorithm yet. So coming back to the starting point, how would it help on the 
non-cooperative game, where p s = ]X p % l Every single-player state p % can evolve in its 
own space, and is related each other just by H % , which depends on all-player state not 
only p l . The following evolution realizes this picture. 

p i (t+l) = et >Bi ®*, (56) 

where H R is the reduced payoff matrix, which means the payoff matrix when all other 
players' states are fixed. It's defined as 

H i R = Tr- i {p l ---p i - 1 p i+1 ---p N H i ). (57) 

Payoff value can also be calculated by the reduced payoff matrix as 

E i = Tr l (p*^) = Tr (p 1 ■ ■ ■ p 1 ' 1 p i p i+1 ■ ■ ■ p N H { ) . (58) 

Now we have the way to get NEs from arbitrary initial strategy: 

p 1 (0) • • • p N (0) - H R (0) - p 1 (1) - Hl(l) - V (l) - . . . -> p) ix • • • p% x . (59) 

The general proof of the existence of the fixed points and the equivalence between such 
fixed points with NEs is in progress. In this paper, we just show the applicable value 
of this evolutionary process by one example, Prisoner's Dilemma, where 
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0,-5 
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More examples and discussion about the stability of the fixed points and its relation 
with refinement of NEs can be found in |12j . 
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Figure 1: The evolutionary procedure applied onto a classical game with single NE, 
Prisoner's Dilemma. The iteration process defined by eau(|56|) with different value of 
parameter 0, ends up at one fixed point, which decreases from a finite number to when 
(3 grows. The meaning of parameter (3 is a measurement of rationality of plavers[TT]. 
and /3 = oo corresponds to full rational, the case assumed in NE. The solution 0, 
means both player choose the second strategy and get —4, —4 respectively at the end. 
This gives the same NE as in Classical Game Theory. 
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5.2 NEs of SRG 



In this section, we will discuss the non-cooperative Nash Equilibria of the Spin Rotating 
Game, defined in eau (|31j) with payoff Hamiltonian eau (|32j) . According to the restriction 
discussed in H4.3| basis {I, iX, iY, iZ} is better to be used here. The payoff Hamiltonian 
will transform consistently. Density matrix of single player state is describe 9 real 
numbers, so the strategy state of the two players is 



pJ-L a 1 (3 1 7 1 

a 1 P22 M v x 

P 1 M 1 P33 s 1 
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(60) 



with the constrain p\' 2 + p^ 2 + p X ^ 2 + p X ^ 
real variables, 



1. Then the payoff is a function of this 18 
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(61) 



Next step, we need to solve all NEs from these two functions. One way to find some, 
but not all, of them is to solve the equations, -g^E 1 = = -^E 2 . Here we still don't 
have the general algorithm for quantum game, so in order to demonstrate how our 
general representation can be used to discuss quantum game in some practical senses, 
we just use this trivial way to get some NEs. The equations gives condition on the 
possible value of all 18 variables as following, 
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- 1 + S 1 = = a 
,i 



a 
P 1 



P22 + P33 

2 6 2 







(3 2 + u 2 



(62) 



Therefore, the NE strategy states could be 
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(63) 



For example, the classical sub-game with an NE p\ = ^ = p 2 , is covered by this general 
NE of quantum game. The intuitive meaning of this general NE can be revealed 
partially by a special case such as p\ = \ = p\, a 1 G [0, |] , which gives the strategies 
as following, 
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(64) 
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This means a combination of this four pure strategies can act as the mixture strategy 
of player 1 in the equilibria. 

Works towards an algorithm for the complete NEs and for general games is still 
in progress. However, by this example, we have shown that our general formalism for 
sure can be used to describe the general quantum game. And only finite real variables 
are required, not like the situation in TQG, where infinite number of parameters are 
needed for general mixture strategy NEs. 

5.3 Prom Quantum Game to Classical Game 

A sub-game of this quantum SRG can be defined as the game restricted only in pure and 
mixture combination of strategies /, iX. One may guess that this sub-game will be like 
the classical PFG, so the payoff matrix should like eau ()29|) . However, the corresponding 
sub-matrix, in fact, is 
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(65) 



Only the diagonal terms agree with the payoff matrix in equ(|29[). but it also has more 
non-zero off-diagonal terms. This raises a question on the condition when a quantum 
game, or a general game given in the manipulative definition as in equ(JHJ), becomes a 
classical game. 

The first case is when only the diagonal part of payoff matrix is chosen as the payoff 
matrix of a classical game. This situation happens when we restrict the strategy density 
matrix only as probability combination of some fixed and given pure strategies. In fact, 
the relation between above sub-game and PFG is such a case. Under such situation, 
the set of pure strategies has to be a priori given. 

The second case is when a special basis can be found, that under this basis both all 
p 1 and all H l are diagonal. This requires two facts, first, all payoff matrix commutate 
with each other, 

[H\W]=0,Vi,j; (66) 
second, the common eigenstates are in the direct-product form, not entangled, 

\E m ) = \E l m )\E 2 m ). (67) 

We have an example of the first CclSG, clS SRG and PFG. However, usually, we don't 
have an concrete example where the requirement in the second case is fulfilled. For SRG, 
although [i/ 1 , i7 2 ] = 0, the common eigenstates are entangled. The two requirement 
in the second case will be fulfilled if the payoff matrices are in the direct-product form: 
H l = h 1,1 ® h 1 ' 2 and [/i* ,m , h 3 ' m ] = 0. But we don't know if there is a real game existing 
in such a form. Therefore, we'd better adopt the first case as the way from quantum 
game to classical game: only the probability combination of given pure strategies can 
act as strategy in the game so that only the diagonal part of payoff matrix is effective. 
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6 Remarks 



Both Classical Game and Quantum Game, both non-cooperative game and coalitional 
game, can be generally unified in the new representation, the operator representation, 
or the Hamiltonian Formalism. We have shown that the new quantum game defined 
in this new representation is different with the Traditional Quantum Game, and is not 
in the scope of Classical Game Theory, which usually uses the probability distribution 
over the set of pure strategies as strategy state. And the entanglement of strategy is 
not the usual meaning of entanglement of object state. 

The classical game and the TQG are just the same thing, except in the latter, 
a lager strategy space has to be used. That's the reason of the conclusion in |10| 
and [7j, it was claimed that, there is no independent meaning of quantum game, only 
possibly with different efficiency. However, our quantum game is different with TQG. 
The probability distribution is replaced by a density matrix. And this replacement 
is significantly different. So, if we compare the classical game with our new quantum 
game, the difference is: both p c and H t,c , state and payoff matrixes of classical players 
are diagonal matrix, while the ones of quantum player and H 1 '® generally have 
off-diagonal elements. This is similar to the difference between classical system and 
quantum system. Therefore, our new quantum game has independent meaning other 
than the classical game, just like the relation between Classical Mechanics and Quantum 
Mechanics, but under the same spirit of Game Theory. By replacing the TQG with 
our new quantum game, the spirit of Game Theory is reserved while the scope of game 
theory is extended. So we are not arguing that the TQG is independent of classical 
game, but our new quantum game is. The operators H used in abstract definition 
looks similar with the matrix form used in [7j, however, with different meanings. In 
our notation, H are operators which give payoff when acting on state of density matrix, 
while in they does not have the meaning of an operator over a Hilbert space, and 
the state of players there is still a probability distribution. 

It's argued in section t j5.3( principally and by one example, lower work load need 
to be done to search for the NEs in our representation than in the traditional quantum 
game. However, neither the existence of the general/special NEs been proved here, 
nor an applicable algorithm to find them has been discovered. The relation between 
our general NEs and Coalitional game has been reached by examples in |14j . but not 
treated generally and theoretically. 

Another thing need to be mentioned is the necessity to introduce the manipulative 
definition. At one hand, in fact, it's not necessary. Here, it's introduced to be a bridge 
between classical and quantum game. From the manipulative definition, it's easy to 
know the quantum games are just games on quantum objects while classical games are 
games on classical objects. At the other hand, it's valuable. Readers from Classical 
Game Theory usually work on games directly at the abstract definition. But we believe 
that every classical game can be mapped onto a manipulative definition, although 
probably not unique. For example, one can always check the background where the 
game comes from. Whenever we have the manipulative definition, quantization of such 
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game will be easy. 
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